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1 Introduction 

Under a partition of the set N we shall mean a sequence (b\, 62 j • • •) of subsets of N such that (i) the 
sets bj are disjoint, (ii) Ujbj — N, (hi) if bk = then also bk+\ = and (iv) if bk+\ ^ then 
min bk < min bk+i- Condition (iv) says that the sequence of minimal elements of the blocks is increasing. 
One can think of partition as a mapping which sends a generic element j € N to one of the infinitely many 
blocks, in such a way that conditions (iii) and (iv) are fulfilled. 

A random partition II = (Bk) of N (so, with random blocks Bk) is a random variable with values in 
the set of partitions of N. This concept can be made precise by means of a projective limit construction 
and the measure extension theorem. To this end, one identifies II with consistent partitions n„ := II|[„] 
(n = 1, 2, . . .) of finite sets [n] := {1, . . . , n}. Note that the restriction II„, which is obtained by removing 
all elements not in [n], still has the blocks in the order of increase of their least elements. 

There is a well developed theory of exchangeable partitions [jjj |l3|; [l7|]. Recall that II = (Bj) is 
exchangeable if the law of II is invariant under all bijections a : N — > N. Partitions with weaker symmetry 
properties have also been studied. Pitman Jlr^ ] introduced partially exchangeable random partitions of N 
with the property that the law of II is invariant under all bijections a : N — > N that preserve the order of 
blocks, meaning that the sequence of the least elements of the sets a(B\) : cr(i?2), ... is also increasing. 
Pitman fll6| ] derived a de Finetti-type representation for partially exchangeable partitions and established 
a criterion for their exchangeability. Kerov [ |l4| ] studied a closely related structure of virtual permutations 
of N, which may be seen as partially exchangeable partitions with some total ordering of elements within 
each of the blocks. Kallenberg Jl3[ ] characterised spreadable partitions whose law is invariant under 
increasing injections a : N — > N. 

In this note we consider constrained random partitions of N which satisfy the condition that, for a fixed 
integer sequence p — (pi, P2, . . .) with pk > 1, each block Bk contains pk least elements of \Jj>kBj, for 
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every k with Bk ^ 0. It is easy to check that this condition holds if and anly if the sequence comprised of 
pi least elements of B\, followed by p2 least elements of B2 and so on, is itself an increasing sequence. 
We shall focus on the constrained partitions with the following symmetry property. 

Definition 1 For a given sequence p, we call IT constrained exchangeable if II is a constrained partition 
with respect to p and the law of II is invariant under all bijections a : N — ► N that preserve this property. 

Since the law of II is uniquely determined by the laws of finite restrictions II n , the constrained exchange- 
ability of II amounts to the analogous property of II n 's for each n = 1,2,.... To gain a feeling of the 
property, the reader is suggested to check that for p = (1, 2,1,.. .) the partition ITg assumes the values 
({1, 3, 5}, {2, 4, 6}, {7, 8}) and ({1, 2, 3}, {4, 5, 8}, {6, 7}) with the same probability. 
Every partition of N is constrained with respect to p = (1,1,...), and every constrained exchangeable 



partition with this p is partially exchangeable in the sense of Pitman [16|. In principle, any constrained 
exchangeable partition may be reduced to some Pitman's partially exchangeable partition by isolating 
Pk — 1 least elements of Bj~ in pk — 1 singleton blocks, for each pk > 1, but this viewpoint will not be 
adopted here. 

For general p ^ (1,1,...) the constrained exchangeable partitions which are also exchangeable are 
rather uninteresting, since they cannot have infinitely many blocks: 

Proposition 2 Let II be a constrained partition with respect to some p which has pk > 1 for some k. 
If II is exchangeable then II has at most k nonempty blocks. 



Proof: Suppose Bk 7^ 0, then by Kingman's representation of exchangeable partitions [ |17| ] the set 
Uj>kBj contains infinitely many elements. For the same reason #Bk > 2 implies that Bk is an infinite 
set, and that partition II' obtained by restricting II to \Jj>kBj and re-labelling the elements of Uj>kBj 
by N in increasing order is an exchangeable partition of N. But then with probability one II' is the trivial 
single-block partition, because elements 1 and 2 are always in the same block. □ 

In many contexts where random partitions appear, exchangeability is an obvious kind of symmetry. 
Constrained exchangeability may appear when some initial elements of the blocks play a special role of 
'establishing' the block. To illustrate, consider the following situation. Suppose there is a sequence of 
independent random points sampled from some distribution on M. d . Define D\ as the convex hull of the 
first pi points, D2 as the convex hull of the first P2 points not in D\, D3 as the convex hull of the first 
ps points not in D\ U D2, etc. Divide R d in disjoint nonempty subsets G\ = Di, G2 = D2 \ D\, G3 = 

D3 \ (Di U D2), A constrained exchangeable partition II of N is defined then by assigning to block 

Bk the indices of pk initial points that determine Dk and the indices of all further points that hit Gk ■ 

Of course, there is nothing special in the convex hulls construction, and any other way of 'spanning' a 
spatial domain Dk on pk sample points and then 'peeling' the space in Gfe's will also result in a constrained 
exchangeable partition. An example of this kind related to multidimensional records will be given. 

In what follows we extend Pitman's JT^ ] sequential realisation of partitions via frequencies of blocks, 
to cover arbitrary constrained exchangeable partitions. Generalising a result on exchangeable partitions 
|^] we shall also derive a central limit theorem for the number of blocks of finite partitions II„ = n|[„] in 
one important case of partitions induced by a 'stick-breaking' scheme. 
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2 Constrained sampling 

We fix throughout a sequence of positive integers p. Recall that a composition is a finite sequence of 
positive integers called parts, e.g. (3, 1, 2) is a composition of 6 = 3 + 1 + 2 with three parts. We say that 
a composition A = (Ai, . . . , Xt) is a constrained composition of n if Xj > pj for j = 1, 1 and 

l A l : = E x j = n - 

For each A a constrained composition of n, the following random algorithm, which may be called 
constrained sampling, yields another constrained composition p of n — 1. Imagine a row of boxes labeled 
1, . . . , t and occupied by Ai, . . . , Xg white balls. Let Aj := Xj + . . . + Xi , j < £. At the first step, p\ 
balls in box 1 are re-painted black and then a white ball is drawn uniformly at random from all Ai — p\ 
white balls. If the ball drawn was in box 1, the ball is deleted and the new composition is p, = (X% — 
1, A2, . • • , Xe), and if the ball drawn was in some other box, it is returned to the box and the process 
continues, so that at the second step pi balls in box 2 are re-painted black and a white ball is drawn 
uniformly at random from boxes 2, . . . , I. If the second ball drawn was in box 2, the ball is deleted and 
the new composition is p = (Ai, A2 — 1, A3, . . . , A^), and so on. If the procedure does not terminate in 
£ — 1 steps, then a ball is deleted from the last box and the new composition is p = (Ai , . . . , Xi~i, Xe — 1). 
By this description, for j < I the transition probability from A to p = (. . . , Xj — 1, . . .) is 

A2 Aj (Aj - P j) 

(Ai - pi) (Aj-_i - pj-t) (Aj - Pj ) ' 

while the transition probability from A to //=(•••, A^ — 1) is 

A 2 Ai 
(Ai - pi) {Ae-i - pe-i) 

A random sequence C = (C n ) of constrained compositions of integers n = 1, 2, ... is called consis- 
tent if C„_i has the same law as the composition derived from C n by the above constrained sampling 
procedure, for each n > 1. Every consistent sequence (C n ) is an inverse Markov chain with some co- 
transition probabilities depending only on p. By analogy with ^ a consistent sequence C will be called a 
constrained composition structure. 

If the constraints are determined by p = (1, 1, . . .), the constrained sampling amounts to a co-transition 
rule related to the partially exchangeable partitions in [|l6|. The unconstrained sampling (corresponding 
to p = (0, 0, . . .)) leads to composition structures studied in ^ |To| ]. 



3 Basic representation 

For II a constrained partition of N with blocks B%, B2, ■ ■ ■ we define, for each n — 1, 2, . . ., a composition 

C n of n as the finite sequence of positive values in n [n]), #(£?2 D [n]), We call this composition 

the shape of IT n and write C n — shape (II„). 

The number of constrained partitions of [n] with shape A is equal to 
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Similarly, the number of partitions of [n] with shape A = (Ai, 
n' < n) has shape p, = (pi, . . . is equal to 



, Xg) and whose restriction on \n'\ (for 



d(X,p) := 



M., - A. 



where Mj = /ij + . . . + /ife , j < k. 
Introduce a function of compositions 

P(A) 



M« - A* - (p f - A £ ). 
p>i~ piV Af 



P(shape(n„) = A). 



fe-i 

n 

3 =e+i 



M j 



-Pj 
Pj 



(2) 



It is easy to check that the consistency of II„'s with respect to restrictions implies that the C„'s are consis- 
tent in the sense of constrained sampling, therefore appealing to Kolmogorov's measure extension theorem 
we have: 



Proposition 3 The formula 



»(II n = • ) = p(shape( • ))/d(shape( • )) 



establishes a canonical homeomorphism between the distributions of constrained exchangeable partitions 
of "H and constrained composition structures. Conditionally given C n = shape (n„) = A the distribution 
ofH n is uniform on the set of constrained partitions of [n] with shape A. 

The following basic construction modifies the one exploited in [14; Let (Pi, P2, ■ ■ .) bean arbitrary 
sequence of random variables satisfying > and ~}2 k Pk < 1- A constrained exchangeable partition 
II directed by (Pk) is defined as follows. Conditionally given the partition is obtained by successive 
extension of IT n to II„ + i, for each n — 1,2,..., according to the rules: given IT n with shape(n n ) = 
(Ai , . . . , A^), the element n + 1 



(i) joins the block Bj, j < £. with probability Pj, 

(ii) if A^ < pi joins the block Bi with probability 1 



x p 



(iii) and if A^ > pi joins the block Bg with probability Pg or starts the new block Bg + i with probability 
1 K , /', 



Explicitly, for the function p of compositions we have the formula 



p(A) = d(X) E 




-Pi 




P 



(3) 



The next de Finetti-type result states that the construction covers all possible constrained exchangeable 
partitions. The proof is only sketched, since it follows the same lines as in [|l4| |l6| ]. 

Proposition 4 For II a constrained exchangeable partition, the normalised shapes shape(II„)/n 
(considered as sequences padded by infinitely many zeroes) converge in the product topology with prob- 
ability one to some random limit (Pi, P2, . . .) satisfying Pj > and J2j Pj — 1- Conditionally given 
(Pk) the partition IT is recovered according to the above rules (i)-(iii). 
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Proof: The key point is to show the existence of frequencies. This can be concluded from de Finetti's 
theorem for — 1 exchangeable sequences by noting that the indicators l(m belongs to block Bk) for 
m > n are conditionally exchangeable given that the block Bk has at least pk representatives in [n]. 
Alternatively, one can use, as in Jl4{|, more direct Martin boundary arguments which exploit the explicit 
formulas ([!]) and (Q) to show that the pointwise limit of ratios d( ■ , fj,)/d(/j,), as to = \fj,\ — » oo, exists if 
and only if fij/m converge for every j. □ 



4 The formation sequence 



Nacu [|15|| established that the law of a partially exchangeable partition is uniquely determined by the law 
of the increasing sequence of the least elements of blocks. We show that a similar result holds for every 
constrained exchangeable partition II with general p. 

We define the formation sequence to be the sequence obtained by selecting the p^th least element of 
the block Bk of II, for fc = 1,2,.... For a composition A let q(X) be the probability that the formation 
sequence starts with elements Ai, Ai + A2, ■ ■ • , Ai + . . . + At. Let (Pj) be the frequencies as in Section 
pi and introduce the variables 



H k = 1 - Pj , so P k = Hk-i - H k 

3=1 



where we set Hq = 1. Then 



q(X u ...,X e )=E 



TT ( X]+1 1 ) H P J +1 (1 - H^+i-ft+i 



(4) 



Comparing this with (^J) written in the same variables (where Hq = 1) we obtain for constrained compo- 
sitions 



p(X)=d(X)l 



(5) 



which leads to the following conclusion: 

Proposition 5 There is an invertible linear transition from p to q. Hence each of these two functions 
on compositions uniquely determines the law ofIL 

Proof: The substantial part of the claim is showing that we can compute p from q. To that end, start 
by observing that p is uniquely determined by the values on compositions of the type (Ai, . . . , A^_i, pi). 
To see that this follows from the consistency for various n, argue by induction in to = 0, . . . , pg for 
compositions ( . . . , pi — rri). Now, for such compositions whose last part meets the constraint exactly, (Q) 
and ([I]) involve the same factors of the type Hj 3 , hence p can be reduced to q by expanding each factor 
(Hj-i - Hj) k = ((1 - Hj) — (1 — Hj-i)) k using the binomial formula. □ 
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5 The paintbox 

Paintbox representations based on the uniform sampling from [0, 1] are often used to model exchangeable 
structures and their relatives [^; [| fj"7[ ], We shall design a version that is appropriate for constrained 
exchangeable partitions. 

Let 1 = Hq > Hi > H2 > ... > be an arbitrary nonincreasing random sequence. Let ({/„) be a 
sequence of independent [0, 1] -uniform random points, independent of (-fffe). We define a new sequence 
(f^n) I p{Hk) with some of f/„'s replaced by if^'s, as follows. Replace U\, . . . , U Pl , by H\. Then replace 
the first P2 entries which belong to U Pl , U Pl +i, . . . and hit [0, H\[ by Inductively, when Hi, ... , Hk 
get used, respectively, pi, . . . , pk times, keep on screening uniforms until replacing the first pk+i points 
hitting [0, Hk[ by Hk+i- Eventually all iJ^'s will enter the resulting sequence. 

The construction has an interpretation in terms of the classical theory of records (see |l4|] for a 
special case). 

Proposition 6 Conditionally given (Hk), the sequence (U n ) | p(-fffe) has the same distribution as (U n ) 
conditioned on the event that the sequence of lower records in (U n ) is (Hk), with the record value Hk 
repeated pk times. 



In this framework, we define a partition II by assigning to block Bk all integers which label the entries of 
(U n ) I p (Hk) falling in [Hk, H k -i[ . Given (H k ), the chance for U n to hit [Hj,Hj-i [ is Pj = Hj-i-Hj, 
therefore the construction is equivalent to that defined by the rules (i)-(iii) above. 



6 Stick-breaking partitions 



Explicit evaluation of the function p is possible when the frequencies involve a kind of independence. 
To this end, it is convenient to introduce yet another set of variables (Wk) (sometimes called residual 
fractions) which satisfy Hk = Wi ■ ■ ■ Wk, Wk € [0, 1]. In these variables (Q) becomes 



p(X) = d(X) E 



t-x 



i=i 



(1 - w e ) {Xe - pe) + 



(6) 



where Aj = Xj 



Xe. As in [160, if the Wk's are independent, (jg) assumes the product form 



with the decrement matrices 
q k (n : m) 



fc=i 



n - p k 



Pk 



m 



E [(1 - W k ) 



1 < m < n, 



(7) 



(8) 



and the convention (_') = l(i — j) for negative arguments of the binomial coefficients. In fact, (Q) 
forces representation (^) (this fact is implicit in [|l4| |l6|| in the case of partially exchangeable partitions): 

Proposition 7 A constrained composition structure (C n ) satisfies (0) with some decrement matrices 
qk , k = 1, 2, . . ., if and only if there exist independent [0, \]-valued random variables (Wk) such that (||) 
holds. 
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Proof: We argue the 'only if part. For n < p\ we have qi(n : n) = 1 by definition. For n > p\ the 
constrained sampling consistency yields 

m + 1 — pi . n + 1 — to 

9i(n : to) = qi{n + 1 : to + 1) H gi(n + 1 : to) 

n + 1 — pi n + 1 — p\ 

which is the familiar Pascal-triangle recursion in the variables n — pi, to — pi, therefore the integral 
representation ^ follows as a known consequence of the Hausdorff moments problem. The case fc > 1 
is completely analogous. The independence of the Wk's is obvious from (Q). □ 

We note in passing that the product formula (^) with a single decrement matrix leads, in a related setting 
of regenerative composition structures, to a nonlinear recursion and a very different conclusion [Q]. See 
fli"lj ] for product formulas of another kind in the exchangeable case. 

Suppose now that Wk's are independent and have beta(afe, bk) distributions, whose density is 

(l-s)°*-V*-7B(a fc ,& fc ). 

The rows of the decrement matrices are then Polya-Eggenberger distributions 

, v / n ~ pk\{ak)m-p k {bk)n- m 1 

q k (n:m)=[ / f , \ , m = l,...,n. 

\m-pkj {a k + b k ) n -p k 

For instance, taking positive integer a k , bk and pk = a>k + bk — 1, a partition IT is constructed as follows: 
replace Ui, . . . , U pi by the value Hi equal to the feith minimal order statistic of these points, then replace 
the first p2 uniforms that hit [0, Hi[ by the value H2 equal to the 62th minimal order statistic of these 
hits, etc, thus defining a partition via (U n ) \ p(-Hfc)- A distinguished class of structures of this kind is 
the Ewens-Pitman two-parameter family of exchangeable partitions [ |l2| ; [To] ; |l7| l with p = (1,1,...), 
a,k = 9 + ka and b k — 1 — a (for suitable a and 8); the product formula simpifies in this case due to a 
major telescoping of factors. 



7 Counting the blocks 

Let K n be the number of blocks of IT n , which in the (Uj) \ P (Hk) -representation coincides with the 
number of intervals ] Hi , Hq] , ] Hi , Hi] , . . . discovered by the n first terms of the sequence. Conditionally 
given (Hk), K n is the number of certain independent geometric summands which sum to no more than n. 
In particular, the difference between the fcth and the (fc + l)st entries of the formation sequence follows 
the negative binomial distribution with parameters pk, Hk- 

We shall proceed by assuming a 'stick-breaking' scheme Hk = W\ ■ ■ ■ W k , k — 1,2, ... , with inde- 
pendent identically distributed WVs. We assume further that the logarithmic moments p = E[— log Wi], 
a 2 = Var[— log Wi] are both finite. The idea is to derive a CLT for K n from the standard CLT for re- 
newal processes [ph. Similar technique was used in [S &h, but in the new stuation we need to also limit 
the growth of p k as fc — > 00. 

We will show that K n is asymptotic to J„ := max{fc : Hf. > 1/n}. The last quantity is indeed 
asymptotically Gaussian with the mean (logn)//i and the variance (log n) / (a 2 p~ 3 ) because J n is just 
the number of renewal epochs within [0 , log n] of the renewal process with steps — log Wk ■ In loose terms, 
we will exploit a 'cut-off phenomenon' : typically, only a few points out of n uniforms fall below 1/n, 
while for fc < J n essentially all intervals get hit, with exponentially growing occupancy numbers when 
scanned backwards in fc from k — J n . 
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Proposition 8 Suppose II is directed by Hk = W\ ■ ■ ■ Wk, where for k — 1,2,... the Wk 's are i.i.d. 
with finite logarithmic moments [i = E[— logWi], cr 2 = Var[— log W\]. If 



log 



k 
3=1 



o(k) , as k — > oo, 



(9) 



then the strong law of large numbers holds, i.e. K n ~ logn a.s.. Moreover, the random variable 
(K n — E [K n ] ) / yVar [K n ] converges in law to the standard Gaussian distribution, whereas the moments 
satisfy 



(10) 



Proof: By the construction of {Uf) \ p {Hk), we have a dichotomy: J7 n G ]Hk, Hk-i] implies that either 
U n will enter the transformed sequence or will get replaced by some Hi > Hk- Let U\ n < ... < U nn be 
the order statistics of U\, . . . , U n . It follows that 

(i) if U jn > H k then K n < j + k, 

(ii) if U mn < H k for m = Y,i=i Pk then K n > k. 

Define £ n by U^ n>n < 1/n < U^ n+lin and recall that J„ was defined by Hj n +i < 1/n < thus ^„ 
is the number of uniforms to the left of 1/ n, and J n follows the CLT. Clearly, J n and ^„ are independent 
and is binomial(n, 1/n). By (i), we have K n < J n + ^„ where is approximately Poisson(l), which 
yields the desired upper bound. 

The lower bound is more delicate. Introduce 

[log nj 

where c should be selected sufficiently large. Then by the assumption (^) log^Vi = o(logn), which 
is enough to assure that the number, say L n , of the -ff^'s larger than ip n /n is still asymptotic to J n . 
Because L n is close to Gaussian with moments as in (|ic|), an easy large deviation estimate implies that 
the inequality L n < (c/2) logn holds with probability at least 1 — nT 2 . On the other hand, the number 
of uniforms smaller cf> n /n is also close to Gaussian with both central moments about </>„, hence, in view 
of </>„ > clogn, a similar estimate shows that this number is at least (c/2) logn with probability at least 
1 — ri~ 2 . By application of (ii) with k = L n we see that the lower bound K n > L n holds up to an event of 
probability 0(n~ 2 ). This completes the proof of the CLT. Finally, since both J n and L n are asymptotic 
to log n almost surely, the Borel-Cantelli lemma implies that the same is valid for K n . □ 



8 A continuous time process 

The sequential construction of II from the frequencies (Pk ) can be embedded in continuous time by letting 
the elements 1,2,... arrive at epochs of a rate-1 Poisson process on R+. Let Rt be the total frequency of 
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the blocks which are not represented by the elements arrived before t, then R — (R t ) is a nonincreasing 
pure-jump process with piecewise-constant paths and Rq = 1. 

Suppose as in Section [7] that Wk's are independent and identically distributed. The process R is then 
easy to describe: if after the (k — l)st jump the process R is in state s then the time in this state has 
distribution gamma(pi,, s), and thereafter the state is changed to sWfe. The sojourns in consequtive states 
1, Wi, W1W2, ... are independent. The instance p = (1,1,...) corresponds to a known self-similar 
Markov process which appears as a 'tagged particle' process in random fragmentation models [[[]]. For 
general p the process is no longer Markovian, as one needs to also include the time spent in the current 
state to summarise the history. 

A minor adjustment of Proposition [| to the continuous-time setting allows to conclude that under the 
same assumptions the number of jumps during the time [0, T] is approximately Gaussian, as T — > 00. 
In fact, the process R is well defined for arbitrary positive values pk (k — 1,2,.. .), in which case an 
analogous CLT is readily acquired by interpolation from the case of integer p^'s. 

9 Example: the chain records 

Next is an example of Pitman's partially exchangeable partitions, so the constraint is p = (1, 1, . . .). 
Consider a Borel space Z endowed with a distribution p and some measurable strict partial order -<. For 
a sample Vi, V2, ■ ■ ■ from (Z, p), we say that a chain record occurs at index j if either j = 1, or j > 1 
and Vj is -(-smaller than the last chain record in the sequence Vi, . . . , Vj-\. The instance of M d with the 
natural coordinate-wise partial order was discussed in [^[j. 

Let Rk, k = 1, 2, . . ., be the sample values when the chain records occur; the sequence (Rk) is a 
'greedy' falling chain of the partially ordered sample (Vj). Introducing the lower sets L v :— {u G Z : 
u ~< v}, we define Dk := Lji k , Gk '■= Dk \ -Dfc-i (where Dq := 0), and we define a constrained 
exchangeable partition II = (Bk) as in Section [jj The frequencies of Bfe's are Pk = p(Lo k ), and we 
have Hk = p(Lp k ), as is easily seen. 

To guarantee a 'stick-breaking' form of (Hk), as in Section 0, we need to assume a self-similarity 
property of the sampling space. We may call (Z, p, -<) regenerative if (i) p(L v ) > for /i-almost all 
points v G Z, and (ii) the lower section L v with conditional measure p(-)/p(L v ) is isomorphic, as a 
partially ordered probability space, to the whole space (Z, p, -<). Since all L v 's are in this sense the 
same, the -fffc's undergo stick-breaking with i.i.d. residual fractions whose distribution is the same as that 
of Lv x . Under the hypothesis of Proposition || the number of chain records among the first n sample 
points is approximately Gaussian, since this number coincides with the number of blocks of II„. A class 
of regenerative spaces is comprised of the Bollobas-Brightwell box-spaces [&, which have all intervals 
{u : v -< u -< w} for v -< w isomorphic to the whole space (and not only lower sections). 

Further examples of regenerative spaces appear, in a disguise, in the context of multidimensional data 
structures like quad-trees or simplex-trees [0]. More generally, constrained exchangeability appears in 
connection with data structures which allow multiple key storage at a node of the search tree. 
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